MMM'ninnn: 

■33 

Mas 


OF  EDUCATION 


Cofog*  of  Agtfailfur*  and  Lif*  Sciences 


The  Information  Content  of  Picture-Text 
Assembly  Instructions 


George  -  8.  /MegAr 
Marvin  D.  Clock 


Technical  Report  Ho.  5 


Reproduction  in  whole  or  part  is  permitted  for  a ay  purpose  of  the  United 
States  Government 


This  research  was  sponsored  by  the  Personnel  and  Training  Research* Programs, 
Psychological  Sciences  Division,  Office  of  Naval  Research,  under  Contract 
NO.  N00014-80-C-0372 ,  Contract  Authority  Identification  Number  NR157-^52. 


This  report,  SO.  6,  Series  B,  is  issued  by  the  Reading  Research  Group, 
Department  of  Education,  New  fork  State  College  of  Agriculture  and  Life 
Sciences ,  a  Statutory  College  of  the  State  University,  Cornell  University, 
Ithaca,  N.Y.  1U853.  It  is  supported  in  part  by  Hatch  Funds  Project 
0k2k,  PRES.  8TRAT.  IMP.  COMP.  PRINT  TECH.  MAT. 


Approved  for  public  release;  distribution  unlimited. 


82  10  29  042 


DTir 

electe 


OCT  2  9  1982 


Unclassified 


AECUftlTY  CLASSIFICATION  OF  THIS  PAGE  (Whan  Data  Bntarad) 


REPORT  DOCUMENTATION  PAGE 


rmnw  rr  ? 


Technical  Report  No.  5 


4.  TITLE  (ana  Submit) 

The  Information  Content  of  Picture-Text  Assembly- 
Instructions 


■  AUTHOR?*) 

George  R.  Bieger,  Bucknell  University 
Marvin  D.  Glock,  Cornell  University 


S.  PERFORMING  ORGANISATION  NAME  ANO  ADORESS 

Cornell  University,  Dept,  of  Education,  N.Y. 

State  College  of  Agriculture  &  Life  Sciences: 

A  Statutory  College  of  the  State  University _ 

It.  CONTROLLING  OFFICE  NAME  ANO  ADDRESS 

Personnel  and  Training  Research  Programs  - 
Office  of  Naval  Research  (Code  458) 

A  —A  J  — _ i. _  ...  OrtA.  ^ 


A  ADDRESS?!/  dittarm t«  ham  Controlling  Otnaa) 


READ  INSTRUCTIONS 
BEFORE  COMPLETING  FORM 


S.  RECIPIENT'S  CATALOG  NUMBER 


S.  TYPE  OF  REPORT  ft  PERIOD  COVERED 

Technical  9/1/81-3/31/82 


S.  PERFORMING  ORG.  REPORT  NUMBER 

technical  Report  6,  Series  B 


S.  CONTRACT  OR  GRANT  NUMBER?*) 

N0001U-80-C-0372 


OGHAM  ELEMENT.  PROJECT, 
REA  S  WORK  UNIT  NUMBERS 


6ll53N(U2) 

RR0420602'-1 


12.  REPORT  OATE 

March  1982 


RR0J+2-06 

HR157-U52 


URITY  CLASS,  (at  thla  rapart) 

Unclassified 


IS.  DISTRIBUTION  STATEMENT  (at  thla  Kapart) 

Approved  for  Public  Release;  Distribution  Unlimited 


17.  DISTRIBUTION  STATEMENT  (at  tha  i 

No  restrictions 


l  m  fwwW  In  mi9ok  29,  it  dfvfaranf  from  Rftt) 


It.  SU^^tCMCMTAMV  NOTES 

This  research  was  also'  supported  by  Hatch  funds  Project  #4 24,  PRES,STRAT. 
IMP. COMP.  PRINT  TECH  MAT,  N.Y.  State  College  of  Agriculture  and  Life 
Sciences;  a  Statutory  College  of  the  State  University 


ft.  KEY  WO  A  08  (Gmtkmm  m  mvwn  »i4m  it  Miiimy  ant  ftmtUY  t y  Mm*  mater) 

Picture-Text  combinations,  procedural  instructions,  categories  of 
information,  comprehension,  stimulus  variables,  picture-text  learning, 
information  taxonomy 


20.  ABSTRACT  (CaMhata  an  tararaa  a  I  da  It  naeaaaary  and  Idantlty  Sr  Mac*  n—  Sir) 

A  taxonomy  of  the  categories  of  information  depicted  in  picture-text  instruct 
tions  for  two  procedural  assembly  tasks  was  developed  and  used  experimentally. 
Three  categories  of  information  were  hypothesized  to  be  the  "necessary  and 
sufficient"  information  for  successful  execution  of  the  procedures.  Various 
combinations  of  information  were  presented  to  108  subjects,  each  in  one  of 
36  instructional  conditions.  Comparison  of  performance  data  for  two  tasks 
indicated  that  subjects  using  "complete"  instructions  finished  the  assemblies 


i  jan  n 


EDITION  OF  I  NOV  BB  IB  OBSOLETE 
S/N  0102-LF-01  4*4401 


Unclassified 


SECURITY  CLASS! FIC 


Unclassified 

tSCUWTV  CUAM4HCAT10W  OF  THIS  PASS  (SS—  omm  SX— <0 


#20  continued 

tn  significantly  less  tine  and  with  significantly  fever  errors  than  did 
;hose  using  "incomplete"  instructions*  thus  confirming  the  experimental 
lypothesis. 


Unclassified 

sscwwtv  CLOsmwcoTtow  or  this  sseswei 


Picture-Text  Information 


-  1  T 


\ 

J 


ABSTRACT 


A  taxonomy  of  the  categories  of  lnfomation  depicted  la  picture- 
text  instructions  for  two  procedural  assembly  tasks  was  developed  sad 

used  experimentally .  Three  categories  of  information  were  hypothesised 
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to  be  the  ^necessary  and  sufficient'1  information  for  successful  execu¬ 
tion  of  the  procedures.  Various  combinations  of  information  were  pre¬ 
sented  to  108  subjects,  each  in  one  of  36  Instructional  conditions. 
Comparison  of  performance  data  for  two  tasks  indicated  that  subjects 
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using  ''complete”  Instructions  finished  the  assemblies  in  significantly 
less  time  and  with  significantly  fewer  errors  than  did  those  using 
^lncomplete^  instructions,  thus  confirming  the  experimental  hypothesis. 


THE  INFORMATION  CONTENT  OF  PICTURE-TEXT  ASSEMBLY  INSTRUCTIONS 


A  major  criticism  of  past  research  on  pictures  and  texts  has  been 
that  the  materials  used  in  that  research  were  rarely  described  In  terms 
of  their  relevant  characteristics  (Stone,  1980).  One  possible  remedy 
is  the  development  and  use  of  a  "taxonomy"  of  categories  of  informa¬ 
tion  to  classify  the  content  of  such  picture- text  materials  in  a  way 
that  would  permit  generalizabllity  to  other  materials.  This  paper  de¬ 
scribes  the  procedures  employed  in  developing  such  a  taxonomy  for  pro¬ 
cedural  assembly  instructions  and  the  initial  attempts  to  validate  that 
'taxonomy  empirically. 

There  has  been  little  research  done  in  the  area  of  identifying  the 
Information  content  of  either  text  or  pictures.  Some  work  in  semantic 

f 

analysis  has  Investigated  the  semantic  roles  filled  by  concepts  as  well 
as  the  semantic  relationships  among  concepts  in  prose  passages. 

Fillmore  (1968)  identified  several  "cases"  that  linguistic  entitles  can 
occupy.  Examples  of  these  cases  include: 

Attentive  -  The  case  of  the  typically  animate  perceived  insti¬ 
gator  of  the  action  identified  by  the  verb. 

Instrumental  -  The  inanimate  force  or  object  casually  involved 
in  the  action  or  state  Identified  by  the  verb. 

These  cesea,  which  were  Incorporated  into  several  other  prose 
grammars  (e.g.,  Klntsch,  1974;  Meyer,  1975),  identify  the  kind  of  seman¬ 
tic  role  that  a  particular  concept  fills  in  a  given  sentence,  proposition 
or  idea  unit.  The  semantic  relationships  among  concepts  were  classified 
by  Grimes  (1975),  whose  predicate  relationships  were  also  adopted  by 
other  analysis  models  (e.g.,  Meyer,  1975).  Some  examples  of  these 
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predicates  Include: 

Covariance  -  Relations  often  referred  to  as  results  or  purposes 
with  one  argument  serving  as  the  antecedent  and  the  other 
serving  as  the  consequent. 

Response  -  Equally  weighted  questlon(s)  and  answer (s),  remark 
and  reply,  or  problem(s)  and  solution(s). 

Both  of  the  classification  systems  illustrated  above  pertain  most 
appropriately  to  linguistic  analyses  of  specific  concepts  conveyed  through 
discourse.  They  try  to  show  how  the  same  words  can  convey  different 
meanings  when  organized  in  different  ways.  They  do  not  attempt  to  charac¬ 
terize  the  broad  categories  of  Information  that  a  passage  contains .  The 
one  notable  attempt  to  identify  the  categories  of  Information  available  in 
a  stimulus  was  a  taxonomy  of  information  contained  in  pictures  developed  by 
Mendler  and  Parker  (1976)  and  expanded  by  Handler  and  Johnson  (1976).  This 
taxonomy  Identified  four  categories  of  Information: 

1.  Inventory  information  -  specifies  what  objects  a  picture 
contains. 

2.  Spatial  location  information  -  specifies  irtwra  objects  are 
located. 

3.  Descriptive  information  -  specifies  the  figurative  detail  of 
the  objects  contained  in  the  inventory. 

4.  Spatial  composition  information  -  specif loo  the  areas  of 
filled  or  empty  space  and  the  density  of  filled  space. 

This  taxonomy  referred  only  to  the  information  available  in  pictures  and 
did  not  include  actions  or  reference  to  what  could  be  inferred  to  be 
happening  in  the  picture. 

Using  the  Maodler  and  Johnson  (1976)  taxonomy  as  a  base,  and  adding 
relevant  categories  from  semantic  case  roles  (Fillmore,  1968)  and  predi¬ 
cate  relationships  (Grimes,  1975),  the  development  of  a  taxonomy  of  the 
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Information  available  in  procedural  picture-text  instructions  vas  begun. 

The  first  step  involved  the  identification  of  the  kinds  of  information 
that  people  used  when  performing  assemblies.  .  This  was  accomplished  by 
having  twenty  undergraduate  student  volunteers  perform  two  assemblies , 
using  a  completed  product  as  a  guide,  while  being  videotaped  and  while 
"thinking  out  loud"  as  they  worked.  One  task  was  the  assembly  of  a  model 
hand  truck  from  a  set  of  blocklike  parts  and  the  other  task  involved  the 
construction  of  a  multi-colored  geometric  pattern  from  pre-cut  felt  pieces. 
Some  of  these  subjects  were  asked  to  return  to  view  their  videotapes  and 
add  information  about  what  they  were  doing,  thinking,  etc.  throughout  the 
assemblies.  From  all  of  these  sources  a  description  of  the  information 
used  in  the  assemblies  was  collected,  condensed,  and  .compared  with  a  "core" 
of  Instructions  that  had  been  developed  earlier.  This  comparison  resulted 
in  the  addition,  modification,  or  deletion  of  several  pieces  of  information 
for  each  set  of  instructions. 

The  second  step  of  the  taxonomy  development  involved  the  re-analysis 
of  the  modified  instructions  using  a  discourse  analysis  system 
(Frederiksen,  1975;  Fine  &  Bieger,  1980).  Having  produced  a  list  of  pro¬ 
positions  which  contained  all  of  the  Information  necessary  for  the 
assembly,  an  attempt  was  made  to  classify  each  proposition  according  to 
one  of  the  categories  described  by  Handler  and  Johnson  (1976) .  In  cases 
where  no  category  seemed  appropriate,  a  new  category  was  defined,  using 
the  case  roles  of  Fillmore  (1968)  and  the  predicate  relationships  of 
Grimes  (1975)  as  guides.  A  list  of  the  categories  of  information  which 
accounted  for  all  of  the  propositions,  and  the  definitions  of  those  cate¬ 
gories,  can  be  found  in  Table  1. 
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Insert  Table  1  about  here 


Two  new  raters  were  trained  In  the  use  of  the  categories  and  were  then 

asked  Independently  to  assign  each  proposition  to  one  of  the  categories. 

.  * 

The  assignments  for  each  proposition  were  then  coopered  among  the  three 
raters.  The  results  of  this  Inter-rater  comparison  are  shown  In  Table  2. 


Insert  Table  2  about  here 


As  can  be  seen  in  Table  2,  there  was  a  high  degree  of  agreement  among 
raters,  suggesting  an  accurate  assignment  of  propositions  as  well  as  a 
reliable  assignment.  Even  in  the  cases  where  there  was  not  unanimous 
agreement,  consensus  was  quickly  achieved  after  a  brief  discussion. 

To  proceed  to  the  next  step  of  preparing  stimulus  materials  the  cate¬ 
gories  of  information  had  to  be  examined  to  determine  the  various  ways  in 
which  they  could  be  depicted  in  text  and  pictures.  Before  describing  how 
the  manipulations  to  the  information  were  determined,  a  thorough  explana¬ 
tion  of  the  taxonomy  might  be  helpful.  A  more  complete  description  of  the 
categories  of  information,  including  relevant  examples,  follows. 

Categories  of  Information 

Inventory  information 

This  information  specifies  the  objects  and  concepts  that  are  depicted 
In  the  stimulus.  Inventory  Information  in  the  text  is  usually  the  names 
of  the  objects  (or  concepts),  and  in  illustrations  is  the  pictorial 


Picture-Text  Information 


depiction  of  the  actual  object.  In  the  following  example  the  underlined 
portions  constitute  the  inventory  information: 

Connect  three  large  blocks  and  &  small  block  end  to  end. 

In  many  situations  the  pictorial  depiction  of  an  object  provides  the 
referent  for  something  mentioned  in  the  textual  portion  of  the  instructions 
This  was  not  the  case  in  the  present  study  in  which  the  names  and  pictorial 
representations  of  objects  were  learned  by  subjects  at  the  start  of  each 
session. 

Descriptive  Information 

This  information  specifies  the  figurative  detail  of  the  objects  or 
concepts  depicted,  that  is,  what  the  object  looks  like.  In  the  present  re¬ 
search,  the  descriptive  information  relevant  to  the  tasks,  such  as  details 
about  the  tab  and  grooves  on  the  blocks,  was  learned  by  the  subjects  with 
che  inventory  information  at  the  beginning  of  each  session. 

Operational  information 

This  Informat lea  dirests  am  agent  to  engage  in  a  specified  action. 

Often  the  agent  is  Implied,  an  in  imperative  constructions  such  as: 

SSStUSi  A**e  large  blacks  and  a  small  block. 

In  this  case,  the  implied  agent  la  the  reader  and  the  specific  operation  is 
one  of  "connection. "  Similarly,  the  operation  Itself  is  often  not  explicit 
in  the  stimulus  bet  meet  be  inferred  by  the  reader.  This  is  especially 
true  of  pictorial  daplctlona  la  which  the  arrangenent  of  objects  implies  an 
operation.  In  a  pilot  study,  during  which  subjects  were  asked  to  describe 
pictures,  many  responses  Included  descriptions  which  reflected  inferences 
about  operations  to  be  performed  on  objects. 
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can  act  as  the  context  for  the  steps  of  that  procedural  sequence.  For 
example,  the  notion  of  "a  column"  can  provide  a  context  for  operations 
Involving  the  three  large  blocks  and  the  small  block.  Similarly,  the 
notion  of  the  "back"  provides  the  context  for  joining  the  columns  with 
the  flat  pieces,  and  the  notion  of  the  "loading  cart"  provides  a  global 
context  for  joining  all  of  the  individual  subassemblies. 

The  nature  of  contextual  information  in  procedural  assembly  instruc¬ 
tions  is  gross,  undetailed,  spatial  or  temporal  Information.  It  may  pro¬ 
vide,  for  example,  the  overall  shape  of  the  finished  loading  cart  if  it 
is  provided  pictorlally;  or,  if  presented  in  text,  it  might  convey  the 
general  location  of  a  subassembly  by  referring  to  "the  back."  Since  it 
does  not  provide  very  detailed  spatial  or  temporal  information,  the  effect 
of  a  given  piece  of  contextual  information,  on  the  performance  of  a 
specific  operation,  is  likely  to  be  a  function  of  its  proximity  to  that 
operation.  That  is,  the  knowledge  that  the  final  product  of  the  entire 
assembly  will  be  a  model  loading  cart  is  not  likely  to  enhance  performance 
in  constructing  a  column.  That  knowledge  is,  however,  likely  to  be  bene¬ 
ficial  when  connecting  the  base  and  back,  or  when  installing  the  handles. 
Covariant  information 

This  information  specifies  a  relationship  between  two  or  more  other 
pieces  of  Information  which  vary  together,  such  as  a  cause  and  effect,  a 
problem  and  solution,  or  an  action  and  a  goal  or  result.  In  the  example 
below,  the  underlined  words  signal  the  covariant  relationship: 

Connect  the  rod  and  the  clip  so  that  the  clip  is  in  the 
middle  of  the  rod. 

Results,  effects,  and  goals  differ  from  contextual  information  in 
that  they  describe  a  particular  state  of  affairs  in  a  rather  detailed 
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fashion,  whereas  contextual  information  conveys  a  more  general  sense  of 
the  outcome  of  a  sequence  of  procedures. 

Temporal  information 

This  information  specifies  the  time  course  of  a  series  of  states 
or  events.  In  the  textual  portion  of  instructions,  time  can  be  indicated 
either  by  use  of  tense  markers  or  by  the  use  of  individual  words  that 
connote  sequence,  such  as  "first,"  "next,"  "then,"  and  "finally."  In 
pictures,  temporal  information  can  be  conveyed  either  by  numbers  indica¬ 
ting  sequence  or  by  the  decomposition  of  a  complex  picture  into  a  sequence 
of  simpler  pictures. 

.Qualifying  information 

This  information  modifies  other  information  by  specifying  the  maimer, 
attributes,  or  limits  of  that  information.  Qualifying  information  is  typi¬ 
cally  provided  textual!?  and  usually  takes  the  form  of  an  adjectival  or  ad¬ 
verbial  phrase.  For  example,  in  the  following  sentence  the  exactness  of  the 
distance  between  columns  is  qualified  by  "about." 

Arrange  the  columns  so  that  they  are  about  two  block 
widths  apart. 

In  pictures,  such  inexactness  is  generally  assumed  unless  more  precise 
measurements  are  indicated  by  the  use  of  drafting  notation,  such  as: 


Emphatic  Information 

This  information  directs  attention  to  other  information.  In  pictures, 
bold  lines,  arrows,  or  differential  use  of  colors  can  all  be  used  to  em¬ 
phasize  some  aspect,  of  a  depiction.  In  text,  underlining,  italics. 


capitalization,  and  the  use  of  phrases  such  as  "be  sure  that"  or  "notice" 
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all  can  be  used  for  emphasis. 

Once  this  taxonomy  of  categories  of  information  was  completed, 
methods  for  depicting  the  certain  categories,  separately  and  in  all 
possible  combinations,  in  both  text  and  picture,  were  explored.  The 
identification  of  the  categories  selected  for  manipulation  and  the 
rationale  for  that  choice  is  discussed  below. 

Modes  of  Presentation 

It  quickly  became  apparent  that  the  full  taxonomy  contained  an  un¬ 
manageable  number  of  classifications.  Further  examination  of  the  instruc¬ 
tions  revealed  that  four  categories  of  information  were  present  at  almost 
every  step  of  both  assembly  sequences.  These  ubiquitous  categories  In¬ 
cluded  Inventory,  Operational,  Spatial,  and  Contextual  information.  The 
remaining  categories  of  information  were  all  present  in  both  sets  of  in¬ 
structions  but  with  much  less  frequency.  The  regularity  with  which  the 
four  most  frequent  categories  appeared  in  two  different  assembly  tasks 
suggested  that  they  might  constitute  the  more  essential  information.  Re¬ 
examination  of  the  protocols  of  subjects  used  in  the  information  descrip¬ 
tion  sessions  revealed  that  the  pieces  of  information  most  frequently  men¬ 
tioned  by  subjects  were  precisely  those  items  falling  into  the  four  more 
ubiquitous  categories.  This  observation  supported  the  hypothesis  that 
these  four  categories  of  information  may  contain  the  necessary,  and  per¬ 
haps  sufficient,  information  for  successful  completion  of  the  assembly 
tasks.  If  it  were  possible  to  depict  each  of  these  categories  of  informa¬ 
tion,  separately  and  in  all  possible  combinations  with  each  other,  in 
text  alone  and  in  pictures  alone,  a  matrix  of  possible  text-picture  com¬ 
binations  could  be  constructed. 

It  was  decided,  in  the  interest  of  making  the  possible  combinations 
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still  more  manageable,  that  since  the  experimental  paradigm  of  teaching 
the  object  names  (including  their  relevant  features  and  pictorial  and 
verbal  identities)  to  100Z  mastery  had  proven  successful  in  previous 
studies,  the  category  of  inventory  information  would  not  be  included 
for  manipulation.  Object  depictions  and  names  would  be  used  as  adjuncts 
to  operational  information,  but  would  not  be  varied  as  a  separate  cate¬ 
gory. 

Preparation  of  "text  alone"  versions  of  the  instructions  containing 
each  of  the  three  categories  (Operational,  Spatial,  and  Contextual)  soon 
exposed  several  problems.  It  became  apparent  that  certain  kinds  of  in¬ 
formation  could  not  be  meaningfully  depicted  in  isolation.  For  example, 
spatial  Information  is  essentially  meaningless  unless  inventory  informa¬ 
tion  is  present.  It  would  not  be  realistic  to  have  lnstructiona  that  con¬ 
vey  notions  like  "end  to  end."  If,  however,  inventory  information  is 
added,  many  readers  often  find  that  certain  operations  are  Implied. 

Similar  problems  arose  with  contextual  information.  Since  much  of  what 
we  call  context  is  a  kind  of  spatial  information,  especially  in  assembly 
tasks,  it  became  apparent  that  the  depiction  of  local  contextual  informa¬ 
tion  was  frequently  confounded  with  both  spatial  and  operational  informa¬ 
tion. 

The  problems  of  isolating  categories  of  information  became  even  more 
apparent  with  the  preparation  of  picture  versions  of  the  instructions. 

How,  for  example,  does  one  depict  context  pictorlally?  The  answer,  ac¬ 
cording  to  several  commercial  graphic  artists,  is  by  drawing  the  finished 
product.  However,  a  pictorial  depiction  of  the  "column"  gives,  in 
addition  to  local  context,  explicit  spatial  information  and  implicit 
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operational  information.  For  this  reason  it  was  decided  to  eliminate 
completely  all  local  contextual  Information  and  to  manipulate  contextual 
information  only  at  the  highest  level. 

These  problems  prompted  the  elimination  of  several  potential  com¬ 
binations  of  information.  Given  the  three  selected  categories  of  Opera¬ 
tional  (0),  Spatial  (S) ,  and  Contextual  (C)  information,  there  existed  the 
potential  for  eight  combinations  in  both  text  and  pictures.  (Nothing,  0,  S, 
C,  OfS,  0+C,  S+C,  and  0+S+C).  This  would  have  resulted  in  a  matrix  of 
picture-text  modes  of  presentation  containing  64  cells.  After  eliminating 
several  combinations  because  of  the  artificiality  or  impossibility  of 
presentation,  six  combinations  remained  in  both  text  and  pictures  (Nothing, 
0,  C,  OfS,  0+C,  0+S+C) .  The  six  combinations  of,  information  generated  a 
presentation  matrix  consisting  of  36  cells.  This  matrix  is  shown  in 
Figure  2. 


Insert  Figure  2  about  here 


The  categories  of  information,  the  combinations  within  modes  (text 
or  picture),  and  the  presentation  matrix  were  taken  to  a  graphic  artist 
and  technical  illustrator  who  described  the  ways  in  which  the  various  pic¬ 
torial  combinations  could  be  depicted.  These  depictions  were  made  using 
line  drawings  that  were  modified  as  necessary.  Textuel  materials  were 
also  developed  to  convey. the  same  combinations  of  information.  Finally, 
the  two  sets  of  materials  were  assembled  into  36  sets  of  instructions 
(i.e. ,  36  modes  of  presentation)  for  each  assembly,  corresponding  to  the 
information  categories  indicated  in  the  presentation  matrix  in  Figure  2. 
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Of  the  36  sets  of  instructions,  15  were  Identified  as  "complete, " 
thst  is,  containing  all  three  of  the  critical  categories  of  information 
hypothesized  to  constitute  the  necessary  and  sufficient  information  for 
execution  of  the  instructions,  and  21  were  identified  as  "incomplete',” 
that  is,  missing  one  or  more  of  the  critical  categories  of  information. 

An  experiment  was  designed  to  determine  the  validity  of  the  criti¬ 
cal  categories  of  information  as  the  "necessary  and  sufficient"  informa¬ 
tion  for  successful  completion  of  the  assembly  tasks;  and,  to  investigate 
the  effect,  on  speed  and  accuracy  of  assembly,  of  variations  in  the 
location  (in  text,  picture,  or  both)  of  the  different' categories  of  in¬ 
formation. 

Method 

Subjects 

One-hundred  and  eight  students  enrolled  in  various  undergraduate 
courses  were  asked  to  volunteer  to  participate  as  subjects  in  this  re¬ 
search  and  received  credit  toward  course  requirements  in  exchange  for 
their  assistance.  Termination  of  a  subject's  participation  was  permitted 
at  any  time  without  penalty,  and  the  privacy  of  all  participants  was 
safeguarded  by  omitting  identification  data  from  all  record  forms. 
Materials 

(a)  Instructions  for  two  assembly  tasks,  prepared  and  arranged  according 
to  the  procedures  described  earlier  (see  Appendix  for  samples  of 
various  instructions). 

(b)  Experimenter  prepared  fabric  pieces  and  tools  for  the  construction 
of  the  fabric  craft  task  designed  by  the  authors. 

(c)  Fischer-Technik  100  Model  Kit  for  the  construction  of  the  model 
loading  cart. 
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(d)  Digital  stop  clock  for  the  recording  of  assembly  times. 

(e)  Sanyo  Model  VC  500 -video  camera  for  the  collection  of  performance 
data. 

(f)  Sanyo  Model  VTC  7100  video  tape  cassette  recorder  for  the  storage 
of  performance  data. 

(g)  Experimenter  prepared  information  and  scoring  forms.  These  forms 
allowed  the  collection  of  background  data  on  subjects  (e.g. t  age, 
major,  etc.)  and  the  recording  of  assembly  times  and  errors  for 
each  step  of  both  assemblies. 

Procedures 

1.  Subjects  were  briefed  on  the  purpose  of  the  study  and  the  nature  of 
their  participation  was  explained. 

2.  The  parts  for  the  first  task  were  introduced,  using  a  parts  identifi¬ 
cation  chart.  The  name  of  the  part  Itself,  its  notable  features, 
and  its  pictorial  depiction  were  pointed  out  to  the  subjects. 

3.  Subjects  were  given  as  much  time  as  needed  to  memorize  the  part  names 
and  identities. 

4.  4m  Informal  quiz  was  administered  to  subjects,  who  were  required  to 
know  the  names  and  identities  of  all  parts  to  100Z  mastery.  If  a 
subject  missed  any  itam(s)  on  the  quiz  he/she  was  corrected,  given 
additional  time  to  study  the  parts,  and  requizzed  until  100%  mastery 

was  achieved. 

5.  Subjects  were  given  one  of  the  36  sets  of  Instructions  for  the  first 
task  and  were  instructed  to  read  and  follow  the  instructions. 

6.  Assemblies  were  scored  for  time  and  accuracy  while  in  progress  and 
the  tape  was  kept  until  the  completeness  of  all  data  was  Insured  and 
interrater  reliability  was  assessed. 
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7.  When  the  subjects  Indicated  completion  or  desire  to  stop  the  first 
task,  procedure  steps  2  through  6  were  followed  for  the  second  task. 
The  set  of  Instructions  for  the  second  task  was  matched  to  the  first 
set  using  row-column  complements  based  on  the  presentation  matrix 
shown  in  Figure  2.  The  order  of  tasks  (i.e. ,  felt  task  or  loading 
cert  first)  was  staggered  (A-B,  B-A,  B-A,  A-B,  etc.). 

8.  Following  completion  of  the  second  task,  subjects  were  fully  debriefed. 


were  allowed  to  obtain  answers  to  all  of  their  questions,  and  were 
informed  of  their  opportunity  to  receive  a  full  explanation  of  results 
and  conclusions  when  available. 


Experiment  I  had  as  its  objective  the  confirmation  of  the  hypothesis 
that  the  three  categories  of  information  chosen  (i.e..  Operational, 

Spatial,  and  Contextual)  constituted  the  necessary  and  sufficient  informa¬ 
tion  for  completion  of  the  assemblies. 

Data  from  three  replications  of  the  presentation  matrix  shown  in 
Figure  2  were  recorded  and  analysed  according  to  completeness  of  instruc¬ 
tions.  Naan  assembly  times  and  mean  number  of  errors,  for  complete  and  in¬ 
complete  groups  on  both  tasks,  are  shown  in  Table  3.  These  data  were  com¬ 
pared  using  a  one  way  AMOVA.  The  results  of  this  comparison  are  summarized 
in  Table  4.  This  analysis  indicates  that  on  both  assemblies  subjects 
receiving  complete  instructions  completed  the  assemblies  in  significantly 
leas  time,  and  with  significantly  fewer  errors,  than  those  subjects  using 
incomplete  instructions.  Farther  examination  of  the  range  of  errors  for 
each  group  indicates  that  on  both  tasks  the  least  accurate  aubject  using 
complete  Instructions  made  fewer  errors  than  the  most  accurate  subject 
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using  incomplete  instructions  (2  as  opposed  to  5  errors  on  the  loading 
cart  assembly,  and  3  as  opposed  to  4  errors  on  the  felt  task).  Although 
there  was  some  overlap  in  the  ranges  of  assembly  times  between  groups,  the 
means  were  found  to  be  significantly  different  even  when  extreme  values 
(i.e. ,  possible  "outliers")  were  omitted. 

Discussion 

Cursory  examination  of  the  results  from  this  experiment  suggest f 
that  the  characterization  as  "necessary  and  sufficient,"  of  the  three  cate¬ 
gories  of  Information  identified  as  Important  was  indeed  accurate.  Not 
only  were  there  statistically  significant  differences  on  all  dependent 
measures  between  complete  and  incomplete  instructional  conditions,  but 
these  differences  were  of  such  magnitude  that  their  educational  significance 
was  self-evident.  For  example,  on  both  tasks,  the  least  accurate  of  all 
subjects  receiving  complete  instructions  still  made  fewer  errors  than  the 
most  accurate  of  all  subjects  receiving  incomplete  instructions.  Indeed, 
these  three  categories  of  Information  (operational,  spatial,  and  contextual) 
appear  to  be  very  important  to  the  successful  execution  of  procedural 
assembly  instructions,  and  at  least  in  regard  to  the  Instructions  used  in 
this  experiment  they  do  in  fact  seem  to  warrant  their  characterization  as 
the  necessary  and  sufficient  information  for  the  successful  completion  of 
the  assembly  tasks. 

This  finding  suggests  that  the  categories  of  information,  identified 
in  the  taxonomy  developed  here,  may  be  a  functional  classification  mechanism 
for  describing  the  information  content  of  procedural  instructions.  The  fact 
that  the  three  manipulated  categories  of  information  had  such  a  dramatic 
Impact  on  both  accuracy  and  speed  of  performance  suggests  that  these  re¬ 
sults  may  have  Important  implications  for  the  design  of  procedural  assembly 
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instructions.  In  such  instructions  it  is  very  important  that  these 
categories  of  information  be  conveyed,  even  if  no  other  information  is 
used.  In  those  situations  where  only  limited  amounts  of  Information  are 
possible,  it  would  be  most  beneficial  to  limit  the  information  content 
to  these  categories.  For  example,  on  many  kinds  of  machinery  there  are 
often  Instructions  for  specific  operations  on  the  equipment.  Typically, 
these  instructions  must  be  brief,  due  to  space  limitations,  and  try  to 
Include  only  the  most  Important  information.  The  results  of  this  study 
suggest  that  the  Important  kinds  of  information  for  assembly  instructions, 
when  inventory  Information  is  already  known,  are  spatial,  operational, 
and  contextual. 

Much  research  In  the  area  of  pictures  and  texts  has  been  faulted  for 
not  describing  the  content  of  the  materials  in  regard  to  their  relevant 
characteristics.  This  taxonomy  was  developed  with  the  hope  that  it  would 
identify  some  of  those  relevant  characteristics.  The  results  of  this  first 
study  indicate  that  that  hope  was  realized.  The  taxonomy  seems  to  have 
identified  Important  categories  of  Information  for  procedural  assembly 
instructions.  It  remains  to  be  seen  whether  or  not  these  categories  de¬ 
monstrate  comparable  utility  in  other  types  of  procedural  instructions  or 
with  nonprocedural  picture-text  materials.  This  taxonomy  may  provide  the 
foundation  for  the  development  of  a  taxonomy  of  information  contained  in 
picture-text  materials  in  general.  One  may  be  able  to  use  such  a  classi¬ 
fication  device  to  compare,  or  at  least  describe,  different  types  of 
materials  in  relation  to  the  distribution  of  various  categories  of  informa¬ 
tion.  For  example,  it  may  be  that  a  functional  difference  between  such 
procedural  tasks  as  assemblies  and  troubleshooting  is  the  relative  fre¬ 
quency  of  one  or  another  category  of  information.  If  such  a  relationship 
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could  be  found,  tasks  could  be  classified  accordingly,  and  instructional 
materials  which  emphasize  the  important  information  for  a  particular  task 
could  be  designed  in  order  to  maximize  performance  (either  speed,  accuracy, 
or  both). 

A  limitation  of  the  research  reported  in  this  thesis  is  that  examina¬ 
tion  of  tasks  other  than  assembly  tasks  was  not  done.  This  was  intentional 
However,  the  generalizability  of  these  results  is  nevertheless  restricted. 
Future  research  in  this  area  might  examine  the  relevance  of  these  cate¬ 
gories  of  information  to  other  tasks,  such  as  reading  for  Information  and 
reading  for  enjoyment,  and  attempt  to  identify  the  Important  categories  of 
information,  without  which  a  set  of  instructions  could  not  be  comprehended 
and  executed. 
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Table  3 
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Representative  Samples  of  Different  Instructional  Combinations 

TEXT 

Operational  Only 
Loading  Cart: 

Connect  three  large  blocks  and  a  small  block. 

Felt  Task: 

Arrange  the  rectangle  and  mark  it. 

Operational  and  Spatial 
Loading  Cart: 

Connect  three  large  blocks  end  to  end  and  connect  a 
small  block  to  the  tab  end  of  this  structure. 

Felt  Task: 

Arrange  the  rectangle  so  that  the  short  edges  are  at 
the  top  and  bottom  and  the  long  edges  are  on  the  sides. 
Find  and  mark  the  midpoints  of  each  side  and  the  center 
of  the  rectangle. 

Cpptffttupl 

Loading  Cart: 

Construct  a  model  hand  truck. 

Felt  Task: 

Make  a  decorative  wall  hanging. 


Appendix  .  (continued) 


Operational  Only 
Loading  Cart: 


PICTURE 


Felt  Task: 


Operational  and  Spatial 


Loading  Cart: 


Felt  Task: 
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